منابع مشابه
A framework for the theoretical evaluation of XML retrieval
This article presents a theoretical framework to evaluate XML retrieval. XML retrieval deals with retrieving those document components, the XML elements, that specifically answer a query. In this paper, theoretical evaluation is concerned with the formal representation of qualitative properties of retrieval models. It complements experimental methods by showing the properties of the underlying ...
متن کاملTheoretical Benchmarks of evaluation methodologies in XML Retrieval
According to INEX, the evaluation initiative for XML retrieval, the aim of XML retrieval is to retrieve not only relevant document components, but those at the right level of granularity, i.e. document components that specifically answer a query. This paper investigates the use of theoretical benchmarks to describe the INEX 2004 and 2005 evaluation methodology. Theoretical benchmarks concern th...
متن کاملHiXEval: Highlighting XML Retrieval Evaluation
This paper describes our proposal for an evaluation metric for XML retrieval that is solely based on the highlighted text. We support our decision of ignoring the exhaustivity dimension by undertaking a critical investigation of the two INEX 2005 relevance dimensions. We present a fine grained empirical analysis of the level of assessor agreement of the five topics double-judged at INEX 2005, a...
متن کاملINEX 2002 - 2006: Understanding XML Retrieval Evaluation
Evaluating the effectiveness of XML retrieval requires building test collections where the evaluation paradigms are provided according to criteria that take into account structural aspects. The INitiative for the Evaluation of XML retrieval (INEX) was set up in 2002, and aimed to establish an infrastructure and to provide means, in the form of large test collections and appropriate scoring meth...
متن کاملStructural Relevance in XML Retrieval Evaluation
• Current approaches to evaluation in XML retrieval rely on ideal recall base • How to evaluate without defining an ideal recall base? • Our Approach: Differentiate between the relevance of a retrieval element in isolation and the relevance of a retrieval element as a member of a set (i.e. a ranked list) of nondisjoint elements using structure of elements in collection Documents XML Elements Me...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM SIGIR Forum
سال: 2012
ISSN: 0163-5840
DOI: 10.1145/2215676.2215689